Systems and methods for efficient targeting

ABSTRACT

A system for determining the physical path of an object can map several candidate paths to a suitable path space that can be explored using a convex optimization technique. The optimization technique may take advantage of the typical sparsity of the path space and can identify a likely physical path using a function of sensor observation as constraints. A track of an object can also be determined using a track model and a convex optimization technique.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims benefit of priority to U.S. Provisional PatentApplication Ser. No. 62/099,343 entitled “Systems and Methods for RadarTargeting,” filed on Jan. 2, 2015, and to U.S. Provisional PatentApplication Ser. No. 62/153,884 entitled “Compressive Sensing,” filed onApr. 28, 2015, the entire contents of each of which are incorporatedherein by reference.

FIELD OF THE INVENTION

This disclosure generally relates to systems and methods for analyzingproperties such as location and motion of objects using sensor signalsand, in particular, for performing such analysis using compressed sensorsignals.

BACKGROUND

In many situations such as automatic maneuvering of airborne objects,underwater objects, objects in the outer space, and for surveillance ofobjects it is necessary to identify objects in a targeted region and todetermine their locations and/or motions. To this end, sensors orimaging devices such as high-resolution cameras, radars, lidars, etc.are used, and the raw sensor signals are processed to extract actionableknowledge, such as identification of an object of interest, such as avehicle in a field, a satellite launched in an orbit, etc. Actionableknowledge or information of interest can also include determiningwhether and how an object may be moving, such as the speed and directionof a vehicle, whether an object in space is tumbling or has left anorbit, etc.

Often, significant amounts of data (e.g., tens or hundreds of megabytes,several gigabytes, or more) must be collected from the sensor and alarge number of computations (e.g., hundreds, thousands, millions,billions, or more floating-point operations) must be performed on thecollected data in order to extract useful, actionable information. Assuch, many sensor and associated data processing systems are bulky andcostly, and they generally consume a lot of power. Compressive sensingcan address some of these challenges. In particular, taking advantage ofthe fact that the collected images are often sparse, i.e., only afraction of the image data is associated with the object(s) of interestand a large portion (e.g., more than 50%) of the image is associatedwith background only, the sensors are adapted to collect only a limitednumber of samples and not the total number of available samples. Thecollected data is generally called compressively sensed data orcompressed data. A co-pending U.S. patent application Ser. No.14/699,871, entitled “Systems and Methods for Joint Angle-FrequencyDetermination” describes using compressed data for joint determinationof angles and frequencies of signals received from targets emitting suchsignals.

The size, cost, and/or power consumption of the sensor, and the amountof data to be transmitted to a data processor from the sensor can thusbe reduced substantially, e.g., by 20%, 30%, 40%, 50%, 60%, etc.Typically, the compressed data is reconstructed by the data-processor toobtain a reconstructed image and the reconstructed image may then beprocessed to extract actionable knowledge or information of interest.The reconstruction process can increase the data processing burdensubstantially and, as such, the size, cost, and/or power consumption ofthe data processing system can increase, and the performance thereof candecrease.

SUMMARY

In various embodiments, methods and systems described herein featuretechniques that can extract actionable knowledge from compressivelysensed data without full reconstruction thereof, thereby minimizing thecost of not only data collection but also data processing. This isachieved, at least in part, by mapping the physical attributes of anobject, such as a physical location in a field, physical motion in thefield, etc., to a path space that can be associated with the compresseddata. The path space can be parameterized according to different typesof expected motions of objects. In particular, instead of reconstructingan image from the observed compressed data, a convex optimization isused select one or more points in the path space that are more likelythan others to correspond to the observed data. Information of interest,such identification of one or more objects or interest, andcharacteristics of their respective motions can then be determined fromthe selected points in the path space.

The computational complexity of this technique is often less than thatof techniques processing uncompressed data or those performing fullreconstruction of compressed data. Thus, the required computationcapacity/power of various embodiments described herein is less than manyother systems used for extraction of information. As compressivelysensed data is used by various embodiments, relatively efficient (e.g.,smaller, less costly, and/or those consuming less power) sensors can beused. In some embodiments, the convex optimization can be performed in adistributed manner and, as such, the compressive sensing and/or dataprocessing can be performed in a distributed manner. In theseembodiments, the cost of individual sensors (in terms of size, powerusage, manufacturing cost, etc.) in a group or cluster of sensors and/orthe cost of individual data processors in a group/cluster of dataprocessors can be reduced even further.

Accordingly, in one aspect, a method is provided for analyzing motionsof objects. The method includes performing by a processor the step of:(a1) representing as a first path point in a path space a first expectedpath of motion of a first point scatterer in a physical space. The firstexpected path in the physical space may include a number of locations inthe physical space. The method also includes (b1) generating by theprocessor a first steering vector based on a first set of phase shiftsat a receiving antenna. The first set of phase shifts corresponds to anassociation between the first point scatterer and the first path point.In addition, the method includes: (c1) computing by the processor afirst field by manipulating several antenna observations using the firststeering vector, and (d1) determining by the processor, based on anintensity of the field, whether the first point scatterer traveled alongthe first expected path.

In some embodiments, the path space includes a parametric space. Atleast one parameter of the parametric space can be: a position, a linearvelocity, and an angular velocity. The representation of the first pathpoint in the path space may include: a three dimensional positionvector; a six dimensional vector that includes a three dimensionalposition vector and a three dimensional velocity vector; or a vectorincluding a six dimensional vector representing rigid body motion and aposition vector.

In some embodiments, the receiving antenna includes N_(E) elements. Eachelement may be associated with up to N_(F) frequencies and up to N_(T)pulses forming a single dwell. Each one of the first set of phase shiftsis associated with an antenna element, one of the N_(F) frequencies, andone pulse. The number of the antenna observations may be less thanN_(E)*N_(F)*N_(T). The first expected path of motion of the first pointscatterer in the physical space may correspond to a single dwell of theantenna, where the single dwell corresponds to N_(E) elements, N_(F)frequencies, and N_(T) pulses.

In some embodiments, the method may further include: (a2) representingas a second path point in the path space a second expected path ofmotion of the first point scatterer in the physical space. The secondexpected path in the physical space may include a number of locations inthe physical space. The method may also include: (b2) generating asecond steering vector based on a second set of phase shifts at thereceiving antenna. The second set of phase shifts may correspond to anassociation between the first point scatterer and the second path point.The method may also include: (c2) computing a second field bymanipulating the set of antenna observations using the second steeringvector, and (d2) determining, based on an intensity of the first fieldand the second field, whether the first point scatterer traveled alongthe first expected path or the second expected path.

In some embodiments, the method further includes: (a2) representing as asecond path point in the path space a second expected path of motion ofa second point scatterer in the physical space, where the secondexpected path in the physical space includes several locations in thephysical space. In addition, the method may include (b2) generating asecond steering vector based on a second set of phase shifts at thereceiving antenna. The second set of phase shifts may correspond to anassociation between the second point scatterer and the second pathpoint. The method may also include: (c2) computing a second field bymanipulating the set of antenna observations using the second steeringvector, and (d2) determining, based on an intensity of the second field,whether the second point scatterer traveled along the second expectedpath. In some embodiments, the method may further include (e)determining via a comparison of the first and second path points whethera rigid body is associated with the first and second point scatters, and(f) determining whether the rigid body traveled along a path in thephysical space associated with the first and/or second expected paths.

In another aspect, a system is provided for analyzing motions ofobjects. The system includes a first processor and a first memory inelectrical communication with the first processor. The first memoryincludes instructions that can be executed by a processing unitincluding the first processor or a second processor, or both. Theprocessing unit may be in electronic communication with a memory modulethat includes the first memory or a second memory or both. Theinstructions in the first memory program the processing unit to: (a1)represent as a first path point in a path space a first expected path ofmotion of a first point scatterer in a physical space. The firstexpected path in the physical space may include a number of locations inthe physical space.

The processing unit is also programmed to: (b1) generate a firststeering vector based on a first set of phase shifts at a receivingantenna. The first set of phase shifts corresponds to an associationbetween the first point scatterer and the first path point. In addition,the processing unit is programmed to: (c1) compute a first field bymanipulating several antenna observations using the first steeringvector, and (d1) determine, based on an intensity of the field, whetherthe first point scatterer traveled along the first expected path. Invarious embodiments, the instructions can program the processing unit toperform one or more of the method steps described above.

In another aspect, an article of manufacture is provided that includes anon-transitory storage medium having stored therein instructions which,when executed by a processing unit program the processing unit, which isin electronic communication with a memory module, to analyze motions ofobjects. The instructions may program the processing unit to (a1)represent as a first path point in a path space a first expected path ofmotion of a first point scatterer in a physical space. The firstexpected path in the physical space may include a number of locations inthe physical space.

The processing unit is also programmed to: (b1) generate a firststeering vector based on a first set of phase shifts at a receivingantenna. The first set of phase shifts corresponds to an associationbetween the first point scatterer and the first path point. In addition,the processing unit is programmed to: (c1) compute a first field bymanipulating several antenna observations using the first steeringvector, and (d1) determine, based on an intensity of the field, whetherthe first point scatterer traveled along the first expected path. Invarious embodiments, the instructions can program the processing unit toperform one or more of the method steps described above.

According to another aspect, a method is provided for analyzing motionsof objects. The method includes performing by a processor the step ofgenerating a set of constraints that includes: (i) a set of observationsat a receiving antenna, and (ii) several sets of phase shifts at thereceiving antenna. Each set of phase shifts includes phase shiftsobservable at the receiving antenna corresponding to a point scattererassociated with a respective path point in a set of path points. Eachpath point may represent in a path space a respective expected path ofmotion of a point scatterer in a physical space. The method alsoincludes determining by the processor intensity of each path point inthe set of path points by exploring a set of fields, where each fieldcorresponds to a respective path point in the set of path points, whilesatisfying the set of constraints.

In some embodiments, the number of the path points in the set of pathpoints, denoted K, is greater than the number of the observations N atthe receiving antenna in the set of observations. Exploring the set offields may include selecting the set of path points such that a numberof near-zero fields in the set of fields is maximized. Exploring the setof fields may include second order cone programming (SOCP).

In some embodiments, the path space includes a parametric space. Atleast one parameter of the parametric space can be: a position, a linearvelocity, and an angular velocity. The representation of a path point inthe path space can be: a three dimensional position vector; a sixdimensional vector that includes a three dimensional position vector anda three dimensional velocity vector; or a vector that includes a sixdimensional vector representing rigid body motion and a position vector.

In some embodiments, the receiving antenna includes N_(E) elements. Eachelement may be associated with up to N_(F) frequencies and up to N_(T)pulses. Each phase shift observable at the receiving antenna may beassociated with an antenna element, one of the N_(F) frequencies, andone pulse. The number of the observations N at the receiving antenna inthe set of observations may be less than N_(E)*N_(E)*N_(T), in someembodiments. Each expected path of motion of the point scatterer in thephysical space may correspond to a single dwell of the antenna, wherethe single dwell corresponding to N_(E) elements, N_(F) frequencies, andN_(T) pulses.

The method may further include identifying a first path, in the physicalspace, of a first point scatterer, based on the respective intensitiesof the path points and, optionally, identifying a second path, in thephysical space, of a second point scatterer, based on the respectiveintensities of the path points. The method may also include determiningvia a comparison of the second path with the first path that both thefirst and second point scatterers are associated with a rigid body.Moreover, the method may include determining a path of the rigid bodyaccording to the first and/or second paths.

In another aspect, a system is provided for analyzing motions ofobjects. The system includes a first processor and a first memory inelectrical communication with the first processor. The first memoryincludes instructions that can be executed by a processing unitincluding the first processor or a second processor, or both. Theprocessing unit may be in electronic communication with a memory modulethat includes the first memory or a second memory or both. Theinstructions in the first memory program the processing unit to generatea set of constraints that includes: (i) a set of observations at areceiving antenna, and (ii) several sets of phase shifts at thereceiving antenna. Each set of phase shifts includes phase shiftsobservable at the receiving antenna corresponding to a point scattererassociated with a respective path point in a set of path points. Eachpath point may represent in a path space a respective expected path ofmotion of a point scatterer in a physical space. The processing unit isalso programmed to determining intensity of each path point in the setof path points by exploring a set of fields, where each fieldcorresponds to a respective path point in the set of path points, whilesatisfying the set of constraints. In various embodiments, theinstructions can program the processing unit to perform one or more ofthe method steps described above.

In another aspect, an article of manufacture is provided that includes anon-transitory storage medium having stored therein instructions which,when executed by a processing unit program the processing unit, which isin electronic communication with a memory module, to analyze motions ofobjects. The instructions may program the processing unit to generate aset of constraints that includes: (i) a set of observations at areceiving antenna, and (ii) several sets of phase shifts at thereceiving antenna. Each set of phase shifts includes phase shiftsobservable at the receiving antenna corresponding to a point scattererassociated with a respective path point in a set of path points. Eachpath point may represent in a path space a respective expected path ofmotion of a point scatterer in a physical space. The processing unit isalso programmed to determining intensity of each path point in the setof path points by exploring a set of fields, where each fieldcorresponds to a respective path point in the set of path points, whilesatisfying the set of constraints. In various embodiments, theinstructions can program the processing unit to perform one or more ofthe method steps described above.

According to another aspect, a method is provided for analyzing motionsof objects. The method includes performing by a processor the step ofreceiving a track model representing a number of candidate tracks ofmotion of an object in a physical space. The track model may include atime variable and a parameter set, each unique value of the parameterset representing a distinct candidate track in the physical space. Thetrack model is generally valid for several data collection intervals.The method also includes receiving observed data from a sensor, wherethe observed data is collected from a start time up to an end time.Additionally, the method includes selecting a number of candidatetracks, where each candidate track is represented by the track model andcorresponds to a respective selected value of the parameter set. Themethod further includes generating using a functional a number of setsof expected sensor data from the track model. Each set may correspondingto both a respective one of the selected candidate tracks and arespective value of the parameter set. The method finally includesidentifying a candidate track as an expected track by optimizing arelation of the several sets of expected sensor data and the observeddata.

In some embodiments, the track model includes or is based on a Keplergravity model. The track model may include a ballistic track model, andthe parameter set of the track model may include a parameterrepresenting total energy of the object, a parameter representingorbital angular momentum magnitude of the object; a subset of parametersrepresenting orientation of an orbit of the object in space; and aparameter representing time of periapsis of the object. The sensor mayinclude a radar, a lidar, or a camera.

In some embodiments, the sensor includes a multi-element radar, and thedata collection interval includes a dwell time of the radar. Optimizingthe relation may include assigning a probability to each candidate trackrepresented by a respective parameter value such that: across allselected parameter values, a summation of a function of the candidatetrack probabilities and respective sets of expected sensor data is equalto the observed data within a specified threshold. Optimizing therelation may also include maximizing the entropy of the assignedprobabilities. In some embodiments, the optimizing the relation includesselecting a parameter value such that a function of the set of expectedsensor data corresponding to that parameter value and the observed datais minimized across all selected parameter values.

The start time may corresponds to a time at which the motion of theobject started, and the end time may correspond to a time at which atrack of the object is to be determined. A time difference between theend time and the start time may include an integer multiple of a datacollection interval.

In another aspect, a system is provided for analyzing motions ofobjects. The system includes a first processor and a first memory inelectrical communication with the first processor. The first memoryincludes instructions that can be executed by a processing unitincluding the first processor or a second processor, or both. Theprocessing unit may be in electronic communication with a memory modulethat includes the first memory or a second memory or both. Theinstructions in the first memory program the processing unit to receivea track model representing a number of candidate tracks of motion of anobject in a physical space. The track model may include a time variableand a parameter set, each unique value of the parameter set representinga distinct candidate track in the physical space. The track model isgenerally valid for several data collection intervals. The processingunit is also programmed to receive observed data from a sensor, wherethe observed data is collected from a start time up to an end time.

Additionally, the processing unit is programmed to select a number ofcandidate tracks, where each candidate track is represented by the trackmodel and corresponds to a respective selected value of the parameterset. The processing unit is further programmed to generate using afunctional a number of sets of expected sensor data from the trackmodel. Each set may corresponding to both a respective one of theselected candidate tracks and a respective value of the parameter set.Moreover, the processing unit is programmed to identify a candidatetrack as an expected track by optimizing a relation of the several setsof expected sensor data and the observed data. In various embodiments,the instructions can program the processing unit to perform one or moreof the method steps described above.

In another aspect, an article of manufacture is provided that includes anon-transitory storage medium having stored therein instructions which,when executed by a processing unit program the processing unit, which isin electronic communication with a memory module, to analyze motions ofobjects. The instructions may program the processing unit to receive atrack model representing a number of candidate tracks of motion of anobject in a physical space. The track model may include a time variableand a parameter set, each unique value of the parameter set representinga distinct candidate track in the physical space. The track model isgenerally valid for several data collection intervals. The processingunit is also programmed to receive observed data from a sensor, wherethe observed data is collected from a start time up to an end time.

Additionally, the processing unit is programmed to select a number ofcandidate tracks, where each candidate track is represented by the trackmodel and corresponds to a respective selected value of the parameterset. The processing unit is further programmed to generate using afunctional a number of sets of expected sensor data from the trackmodel. Each set may corresponding to both a respective one of theselected candidate tracks and a respective value of the parameter set.Moreover, the processing unit is programmed to identify a candidatetrack as an expected track by optimizing a relation of the several setsof expected sensor data and the observed data. In various embodiments,the instructions can program the processing unit to perform one or moreof the method steps described above.

In another aspect, a system for analyzing characteristics of objectsincludes a number of stations including a first station. The firststation includes a sensor and a communication module configured to: (i)receive observations collected by a second station and (ii) exchangedata with a third station. The system also includes a processorprogrammed to solve jointly with the third station, an optimization taskhaving constraints that are based on: (i) observations collected by thesensor, and/or (ii) the received observations. The optimization task maybe solved to determine a characteristic of an object. The sensor mayinclude: (i) one or more receiving elements of a radar antenna, (ii) oneor more receiving elements of a lidar antenna, and/or (iii) a camera.

In some embodiments, the sensor of the first station includes a firstreceiving element of a multi-element radar antenna. The second stationmay include a second receiving element of the multi-element radarantenna. The multi-element radar antenna may have N_(E) receivingelements, and a dwell period corresponding to N_(T) pulses, where eachpulse includes N_(F) frequencies. The system may further include thesecond station and the multi-element antenna. The multi-element antennamay be configured to collect less than N_(E)*N_(F)*N_(T) observations ina single dwell period.

The multi-element antenna may include N receiving elements, where N isgreater than or equal to one, and the sensor of the first station isconfigured to collect observations at a rate not exceeding a fraction ofa rate of information associated with the characteristic of the object.The fraction can be 1/N or less. The sensor of the first station and/orthe sensor of the second station may include a transmission element ofthe multi-element radar antenna.

In some embodiments, the communication module is configured to transmitthe observations collected by the sensor to the third station. The thirdstation can be the same as the second station. The first may include adatabase having the location of the third station relative to the firststation, and the processor may be programmed to modify at least oneconstraint based on, at least in part, the location of the thirdstation.

The first station may include a first unmanned aerial vehicle (UAV) andthe third station may include a second UAV different from the first UAV.The data may include location data, and the processor may be programmedto: (i) compute a location of the third station relative to the firststation, and (ii) modify at least one constraint based on, at least inpart, the location of the third station. The data may include,alternatively or in addition, the computation data generated by theprocessor.

In some embodiments, the sensor is configured to collect observationsvia a dual-use waveform. The communication module may be configured to:(i) receive the observations and/or (ii) exchange the data, via thedual-use waveform. The dual-use waveform may include: a biphase codedwaveform, a biphase coded waveform that includes a pseudorandom sequenceof phase shifts, and/or a Costas waveform. The optimization task mayinclude determination of a path of the object and/or an attribute of theobject.

In another aspect, a method is provided for analyzing characteristics ofobjects. The method includes, performing at a first station in aplurality of stations, the steps of: collecting observations using asensor, and via a communication module: (i) receiving observationscollected by a second station in the plurality of stations, and/or (ii)exchanging data with a third station in the plurality of stations. Inaddition, the method includes solving jointly by a processor and withthe third station, an optimization task having constraints that arebased on at least one of: (i) observations collected by the sensor, and(ii) the received observations, to determine a characteristic of anobject. In various embodiments, the method may perform one or moreoperations the system described above is configured to perform.

In another aspect, an article of manufacture is provided that includes anon-transitory storage medium having stored therein instructions which,when executed by a processing unit program the processing unit, which isin electronic communication with a memory module, to analyzecharacteristics of objects. The instructions may program the processingunit to collect observations using a sensor, and (i) receiveobservations collected by a second station in the plurality of stations,and/or (ii) exchange data with a third station in the plurality ofstations. In addition, the processing unit is programmed to solvejointly by a processor and with the third station, an optimization taskhaving constraints that are based on at least one of: (i) observationscollected by the sensor, and (ii) the received observations, todetermine a characteristic of an object. In various embodiments, theinstructions can program the processing unit to perform one or more ofthe operations the system described above is configured to perform.

In another aspect, a method for analyzing attributes of objects includesperforming by a processor the step of: (a) representing as adistribution of path points in a path space the expected paths of motionof a point scatterer in a physical space. Each expected path in thephysical space may include a number of locations in the physical space.The method also includes (b) generating by the processor a distributionof steering vectors based on a number of phase shifts at a receivingantenna. The phase shifts may correspond to an association between thepoint scatterer and the distribution of path points. In addition, themethod includes: (c) computing by the processor a field-intensitydistribution based on, at least in part, several antenna observationsand the distribution of steering vectors, and (d) determining by theprocessor, based on the field-intensity distribution, a path of a firstpoint scatterer in the physical space.

Computing the field-intensity distribution may include applying adaptiveweights to: (i) one or more of the several antenna observations, and/or(ii) the distribution of steering vectors. The adaptive weights may beselected to minimize interference from an interfering point scatterer inthe physical space. Computing the field-intensity distribution mayinclude partitioning the path space into first-level regions, computingthe field intensity for each first-level region, and selecting afirst-level region having maximum field intensity. Computing the fieldintensity may further include: partitioning path space in the selectedregion into second-level regions, computing the field intensity for eachsecond-level region, and selecting a second-level region having maximumfield intensity. Determining the path in the physical space may includeselecting a representative path point within the selected second-levelregion, and identifying a path in the physical space that corresponds tothe representative path point.

In some embodiments, the method further includes determining, based onthe field-intensity distribution, a path of a second point scatterer inthe physical space. The method may also include determining via acomparison of the paths of the first and second point scatterers that arigid body is associated with the first and second point scatterers. Inaddition, the method may include determining the path of the rigid bodyin the physical space based on the path of the first point scattererand/or the path of the second point scatterer. The method may alsoinclude determining an attribute of the rigid body based on the path ofthe first point scatterer and/or the path of the second point scatterer.The attribute of the rigid body may include a range, a velocity, and anangular velocity.

In another aspect, a system is provided for analyzing attributes ofobjects. The system includes a first processor and a first memory inelectrical communication with the first processor. The first memoryincludes instructions that can be executed by a processing unitincluding the first processor or a second processor, or both. Theprocessing unit may be in electronic communication with a memory modulethat includes the first memory or a second memory or both. Theinstructions in the first memory program the processing unit to (a)represent as a distribution of path points in a path space the expectedpaths of motion of a point scatterer in a physical space. Each expectedpath in the physical space may include a number of locations in thephysical space.

The processing unit is also programmed to (b) generate a distribution ofsteering vectors based on a number of phase shifts at a receivingantenna. The phase shifts may correspond to an association between thepoint scatterer and the distribution of path points. In addition, theprocessing unit is programmed to: (c) compute a field-intensitydistribution based on, at least in part, several antenna observationsand the distribution of steering vectors, and (d) determine, based onthe field-intensity distribution, a path of a first point scatterer inthe physical space. In various embodiments, the instructions can programthe processing unit to perform one or more of the method steps describedabove.

In another aspect, an article of manufacture is provided that includes anon-transitory storage medium having stored therein instructions which,when executed by a processing unit program the processing unit, which isin electronic communication with a memory module, to analyze attributesof objects. The instructions may program the processing unit to (a)represent as a distribution of path points in a path space the expectedpaths of motion of a point scatterer in a physical space. Each expectedpath in the physical space may include a number of locations in thephysical space. The processing unit is also programmed to (b) generate adistribution of steering vectors based on a number of phase shifts at areceiving antenna. The phase shifts may correspond to an associationbetween the point scatterer and the distribution of path points. Inaddition, the processing unit is programmed to: (c) compute afield-intensity distribution based on, at least in part, several antennaobservations and the distribution of steering vectors, and (d)determine, based on the field-intensity distribution, a path of a firstpoint scatterer in the physical space. In various embodiments, theinstructions can program the processing unit to perform one or more ofthe method steps described above.

BRIEF DESCRIPTION OF THE DRAWINGS

In the following description, various embodiments of the presentinvention are described with reference to the following drawings, inwhich:

FIG. 1 schematically illustrates a sensor according to some embodiments,and an example observed field having several objects;

FIG. 2 illustrates adaptive nulling of stationary ground clutterconfined to a clutter ridge in joint angle-doppler space and jamming, todetect moving targets, according to some embodiments;

FIG. 3 depicts a hard-walled four-dimensional class-conditionalprobability density for a clutter class, according to some embodiments;

FIG. 4 depicts a hard-walled four-dimensional class-conditionalprobability density for a target class, according to some embodiments;

FIG. 5 depicts a radar image of a stopped truck with running engine inthe generalized coordinates of height and vibration frequency, accordingto some embodiments;

FIG. 6 illustrates a multiresolution computation of the correctvibrational frequency parameter, according to some embodiments;

FIG. 7 shows an image σ(r, θ, ω) of a rotating scatterer ring, processedaccording to one embodiment;

FIG. 8 shows an image σ(r, θ, ω) of a rotating scatterer ring, processedaccording to another embodiment;

FIG. 9 schematically shows the track of a ballistic target,characterized for many minutes by a handful of orbital invariants,according to some embodiments;

FIG. 10 depicts one particular example of an orbit-fixed referenceframe;

FIG. 11 shows some convex functions that can be used in variousembodiments for object path determination and/or tracking;

FIG. 12 shows multitarget tracks identified as a multimodal probabilitydensity in q-space, according to some embodiments;

FIG. 13 depicts an example geometrical configuration of transmitter,receiver, and a target in a bistatic or multistatic radar;

FIGS. 14A-C show different waveform types that can be used as dual-usewaveforms according to some embodiments;

FIG. 15 shows the spectrum of a signal having a 13-bit Barker sequence;

FIG. 16 depicts the main response and sidelobes of a 1023-point biphasecode with a pseudorandom sequence of phase shifts, according to someembodiments;

FIG. 17 depicts a Costas waveform with segments of LFM chirp in permutedtime-order; according to some embodiments;

FIG. 18 schematically depicts a swarm of unmanned aerial vehicles(UAVs), according to some embodiments;

FIG. 19 schematically illustrates a conventional approach to airborneISR signal processing;

FIG. 20 schematically depicts the SAKÉ system, according to someembodiments;

FIG. 21 illustrates a UAV swarm performing dual band sensing andcommunication, according to some embodiments; and

FIG. 22 illustrates path determination and tracking using classificationfeatures of a target object, according to some embodiments.

DETAILED DESCRIPTION

Generalized Matched Processing

The structure of coherent imaging can be expressed in a uniformlanguage, whatever the physical situation. What is needed is a physicalmodel of the phase of the I&Q data at the sensor in terms of a set ofphysical parameters q. The phase of the radar signal will depend onwideband frequency or sample time (fast time index f), on pulse number(slow time index t) and on array element index e in all the cases of aphased array antenna, a sparse array, or a distributed array comprisingmultiple physical elements. These integer indices form the discretemeasurement space. The complex I&Q data indexed according to these threeintegers can be viewed as a complex tensor z(f, e, t) with threeindices. This tensor is often referred to in the radar literature as thedata cube, because it is a tensor-valued complex quantity of rank three.

We use the vector notation z(f, e, t)=

f, e, t|z

, which expresses the entire set of measurements as a vector |z

in a certain complex vector basis{|f,e,t

:f∈{1 . . . N},e∈{1 . . . D},t∈{1 . . . M}}.This basis is just a set of column vectors that contain a 1 in theposition corresponding to a given combination (f, e, t)| of the threediscrete indices, and a 0 otherwise. This definition of the basis can bewritten compactly as:

$\begin{matrix}{{\left\langle {f^{\prime},e^{\prime},\left. t^{\prime} \middle| f \right.,e,t} \right\rangle = {{\delta\left( {f^{\prime},f} \right)}{\delta\left( {e^{\prime},\epsilon} \right)}{\delta\left( {t^{\prime},t} \right)}}}{{\sum\limits_{f = 1}^{N}{\sum\limits_{e = 1}^{D}{\sum\limits_{t = 1}^{M}{\left. {f,e,t} \right\rangle\left\langle {f,e,t} \right.}}}} = 1}} & (1)\end{matrix}$

A useful interpretation of this notation is that we are implicitlyintroducing a single index n that runs over all of the ordered triples(f, e, t). In order to satisfy Equation 1, it is only necessary thatthis index count each basis vector |f, e, t> exactly once, but this isdetermined by Equation 1 only up to a permutation n (f, e, t)

{f(n), e(n), t(n)}. This permutation is arbitrary, i.e., any combinationof f, e, and t is possible, but it must be remembered. Then we candenote the basis vectors as |n>≡|f, e, t>, and regard the data cube as asingle complex column vector |z> with elements <n|z>=z(f, e, t).Substituting the symbol |n> for the symbol |f, e, t> in Equation 1results in the simplified expressions

$\begin{matrix}{{\left\langle n^{\prime} \middle| n \right\rangle = {\delta\left( {n^{\prime},n} \right)}}{{\sum\limits_{n = 1}^{NDM}{\left. n \right\rangle\left\langle n \right.}} = 1.}} & (2)\end{matrix}$

The phase of the I&Q data is defined by a physical model with parametersq. We can write it as ϕ(f, e, t|q) or ϕ(n|q) and introduce a generalizedsteering vector (a complex row vector) with elements

q|n

≡exp(−iϕ(n|q))  (3)The image σ(q) is a real, positive density in the space of generalizedcoordinates (parameters of the phase functional) labeled by q.

$\begin{matrix}{{\sigma(q)} = {{{\sum\limits_{n}{{z(n)}e^{{- i}\;{\phi{({n|q})}}}}}}^{2} = {\left\langle z \middle| q \right\rangle\left\langle q \middle| z \right\rangle}}} & (4)\end{matrix}$

If the phase model and the hypothesized parameters q match those of ascatterer in the scene, the image in the multidimensional space q willhave a maximum at the coordinates of that scatterer, on account ofterm-by-term phase cancellation in the coherent sum. We refer to themultidimensional space of generalized coordinates as path space, becauseto each point in this space there corresponds one hypothetical path ofthe scatterer throughout the coherent dwell.

With reference to FIG. 1, an illustrative sensor array has 5 elements—e1through e5, i.e., N_(E)=5. A single coherent dwell may include 10frequencies, i.e., N_(F)=10, and 8 pulses, i.e., N_(T)=8. Accordingly,N=N_(E)*N_(F)*N_(T)=400. It should be understood that these arrayparameters are illustrative only and that in general an array can haveany number (e.g., 1, 2, 5, 8, 10, 20, 50, etc., or more) of transmitterand receiver elements. A single coherent dwell may include any number offrequencies (e.g., 2, 6, 8, 10, 15, 30, 40, etc., or more), and anynumber of pulses (e.g., 2, 5, 8, 12, 25, 30, 45, etc., or more).

In one example, the observed field includes five objects O1 through O5.The object O1 is a moving vehicle (e.g., a truck). The location of O1 atone instant can be specified by (r, θ). O1 is moving in a circle aroundthe element e3 at an angular velocity ω. The object O2 is a building.The object O3 is another truck, but it is not moving. The object O4 is abig vehicle (e.g., a ship) moving in a straight line at a velocity ν,and the object O5 is a tree. This example is illustrative only and thatin general, an observed field may include any number (e.g., 1, 2, 7, 10,12, 15, 35, etc., or more) of objects, one or more of which may bestationary and/or moving. One or more objects may move in differentmanners such as traveling along a straight path, curved path,meandering, rotating, tumbling, etc. The observed field, or the physicalspace, can be two dimensional or three dimensional.

Each of these target objects may be associated with one or more pointscatterers in various geometrical arrangements. A point scatterer, ingeneral, is a point of reflection. In some phase models (point scatterermodels) a target object can be well modeled as a collection of pointscatterers. A scatterer that is rigidly attached to an object derivesits motion relative to the radar from two sources (1) the motion of therigid object about its center of mass and (2) the relative motionbetween the radar and the target center of mass. Using these two motionsand the motion of the point scatterers associated with a rigid object,the motion of that object can be determined.

As described above, the set of parameters q can describe the path aparticular point scatterer can take over time. Since q defines aspace-time path, we refer to q as the scatterer's generalizedcoordinates. As some examples of generalized coordinates, for stationaryscatterers, q can be a three-dimensional position vector x, whichdescribes the scatterer position at all times. For scatterers in linearmotion, q=(x0, v) can be a six-dimensional vector including thescatterer's position x0 at some reference time and the three-dimensionalvelocity vector v. For scatterers attached to a rigid body intorque-free motion, the parameters of the path space q=(Ω, s_(b))include the motion parameters Ω and a position vector s_(b). The vectorΩ contains six parameters to describe the motion of the body's center ofmass as well as parameters that describe the motion of the body'sprincipal axes in space. The vector s_(b) describes the position of thescatterer relative to the principal axes of the rigid body.

The motion of point scatterer(s) associated with the object O1 can thusbe represented as one point in a path space representing angular motion.The point scatterers associated with the objects O2 and O3 can berepresented as different points in a path space representing stationaryobjects. The point scatterers associated with the object O4 can berepresented as a point in a path space representing linear motion. Eachof these motions is expected to occur during a coherent dwell period.

Summation and integration being linear operators, we can exchange sumsin Equation (4) and write:

$\begin{matrix}{{\sum\limits_{k}{w_{k}{\sigma\left( q_{k} \right)}}} = {{\sum\limits_{k}{w_{k}\left\langle z \middle| q_{k} \right\rangle\left\langle q_{k} \middle| z \right\rangle}} = {\left\langle z \right.\left\{ {\sum\limits_{k}{w_{k}\left. q_{k} \right\rangle\left\langle q_{k} \right.}} \right\}\left. z \right\rangle}}} & (5) \\{{\int{{w(q)}{\sigma(q)}{dq}}} = {\left\langle z \right.\left\{ {\int{{dq}\left. q \right\rangle{w(q)}\left\langle q \right.}} \right\}\left. z \right\rangle}} & (6)\end{matrix}$which expresses the weighted sum of the image at a discrete set ofpoints in the path space, or the weighted integral of the image over aregion or ball in path space, as a sandwich product of a certaincomputable matrix between the conjugate transpose of the radar data (rowvector) on the left and the radar data (column vector) on the right.Equations (1) through (6) indicate one technique for extractingimportant information from images while performing much less computationthan those needed to reconstruct and evaluate the entire image from thecollected data.

The notion of an object during a coherent dwell period can be determinedas follows. One or more point scatterers, that can reflect radar signalsback to the receiving elements of an antenna as assumed to be associatedwith one or more objects. A path space is generated in terms of theparameter set q for one or more point scatterers. Each point in the pathspace may represent a respective motion of a corresponding pointscatterer in the physical space. The path space can be a continuum ormay include a set of discrete points.

For any particular point in the path space, represented by a value of q,a set of phases of the I&Q data of the receiving elements of the antennacan be computed using Equation (3). These data represent the I&Q signalsthe receiving elements of the antenna would receive if a point scattererwere to actually travel along a physical path represented by the valueof q in the path space. Such sets of phases of the I&Q data can becalled steering vectors, which can be continuous functions of the qspace is continuous, or discrete vectors, one corresponding to eachdiscrete value of q.

A field can be illuminated by manipulating the steering vectors usingthe signals actually observed at the receiving antenna elements, theobserved signal being denoted by z(n) and one manipulation beingrepresented by Equation (4). In the field thus illuminated, the valuesof q that correspond to actual point scatterers have relatively highintensity that values of q that do not correspond to any actual pointscatterers.

Thus, the illumination of the field using the observed radar data z(n)can be used to identify actual point scatterers in the target physicalspace and to determine physical paths of such point scatterrers. If twoor more point scatterers have coordinated paths, it can be inferred thatthose point scatterers are associated with a rigid body such as avehicle. The motion of the rigid body can be determined from thephysical path(s) of the one or more corresponding point scatterers.

Generalized Adaptive Processing

Adaptive weights are generally known in radar from Space Time AdaptiveProcessing (STAP) in which these weights are used to deeply null groundclutter to improve the detectability of moving targets against a strongstationary background. Adaptive weights appear in a more general form inour GMAP framework that allows this scheme to be extended and improved.

When weights are included in the coherent sum, Equation 4 becomes:

$\begin{matrix}{{\sigma(q)} = {{{\sum\limits_{n}{{w(n)}{z(n)}e^{{- i}\;{\phi{({n|q})}}}}}}^{2} = {\left\langle w \middle| q \right\rangle\left\langle q \middle| w \right\rangle}}} & (7)\end{matrix}$On the left, we have pulled the measurement vector z(n) into thedefinition of the vector |q

to emphasize the important role of the adaptive weights |w

. The new definition of the vector |q

including the measured data z isq _(n) =

n|q

=z(n)e ^(−iϕ(n|q))  (8)

If the weights are real, they do not affect the positions of peaks inthe path space q, but only modify the sidelobes and the resolution ofthe image. If they are complex, they are capable of modifying the imagein any way, including emphasizing peaks or creating nulls. This requiresa variational principle for designing adaptive weights. To obtain thisvariational principle, we suppose that classes of targets are definedaccording to class-conditional probability densities over path space.Let the targets we wish to detect have probability p(q|S) for signal andthe classes we wish to suppress have probability p(q|I) forinterference. The projection operator corresponding to the signal classis Ŝ=∫dq|q

p(S|q)

q| and the operator corresponding to the interference class is Î=∫dq|q

p(I|q)

q|.

To find the weights that detect the signals and suppress theinterference, we need to maximize the signal-to-interference ratiodefined by:

$\begin{matrix}{{SINR} = \frac{\left\langle {w{\hat{S}}w} \right\rangle}{\left\langle {w{\hat{I}}w} \right\rangle}} & (9)\end{matrix}$subject to

w|w

=1. The variational principle in Equation 9 is derived formally usingBayes rule. The complex weights |w

can be calculated as the eigenvector of the matrix Î⁻¹Ŝ belonging to themaximum eigenvalue, which is then the SINR. An alternative procedure isto use convex optimization to find the weights. This type ofmathematical optimization may involve a complex generalized Rayleighquotient

To briefly summarize the conventional STAP signal processing techniquefor airborne moving target detection, it is assumed that the antenna isa uniform linear array (ULA) that in the simplest case moves colinearlywith the surveillance aircraft. In this restricted case, it is sensibleto speak of target radial velocity as velocity projected onto the arraynormal, and target angle as the angle of the target off the arraynormal, so that the round trip phase of a monochromatic signal offrequency f for a pulse emitted at time t from element e can be writtenin a simple functional form as ϕ(f, e, t|r, v, θ)=ϕ(n|r, v, θ). It isobserved that stationary clutter on the earth at a range R isconcentrated on a diagonal ridge in the joint transform spaceangle-doppler as illustrated in FIG. 2. Adaptive weights over elementindex and pulse time are used to place a deep null on the stationaryclutter ridge to render the moving target detectable.

In Generalized Match Processing, the array may not be linear, and havingno boresight, neither the concept of radial velocity nor the concept ofangle off the array has any meaning. But a scatterer at position (x, y)in the ground plane moving with velocity (v_(x), v_(y)) can beunambiguously represented. For calculating the adaptive weights, it isnecessary to substitute the four-dimensional path-space q=(x, y, v_(x),v_(y)) for the three-dimensional path space q=(r, v, θ) that appears inconventional STAP.

FIG. 3 illustrates an example conditional probability distribution forthe clutter class I. The illuminated footprint on the ground is shown onthe right, and the region of velocity space to be nulled is shown on theleft. Class-conditional probability density for a clutter class isdescribed as having net speed below a threshold (as illustrated on theleft) and position within a specified footprint on the ground (asillustrated on the right. FIG. 4 shows a corresponding conditionaldensity for the target class S. Class-conditional probability densityfor a target class is described as having net speed above the clutterthreshold (as illustrated on the left) and position within a specifiedfootprint on the ground (as illustrated on the right). The meaning ofthese densities is that the weights will be chosen to null targets in asteered footprint on the ground near zero speed and detect targets inthe same footprint on the ground with speed greater than the cutoffspeed. These class probability densities can be used in GMAP to definethe class operators Ŝ and Î, and the adaptive weights |w

over the measurement. GMAP can also be used to determine the physicalpaths of point scatterers and objects as described above. In fact, theadaptive weights can be used to suppress interference or clutter.

Target Attribute Extraction

FIG. 5 is an illustration of how GMAP can help facilitate persistent,automatic ground target track. Radar data was simulated for a 13-foottall truck with four discrete scatterers at heights of 1 m, 1.5 m, 2 mand 3.5 m. A 94-GHz radar with bandwidth 2 GHz was placed above thetruck in this simulation. The truck was modeled as completely stationaryexcept for a small vertical vibration at a rate of 20 Hz with anamplitude of 1 cm. This simulates, for example, a vehicle stopped at anintersection with the engine running.

The frequency of 20 Hz is characteristic of the mass of the truck andthe stiffness of the vehicle suspension. The running engine provides asource of mechanical noise to excite the resulting damped mass-springsystem. The phase of the round-trip radar signal is determined by theheight of a scatterer above the ground and the characteristic frequencyof the forced, damped oscillations, which formed a pair of generalizedcoordinates q=(z,w). The figure shows the image σ(z,w) of the stoppedtruck calculated from the simulated radar data with an integration timeof 0.013 seconds at a pulse-repetition frequency (PRF) of 2 kHz. Thisimage was calculated from the simulated 94 GHz radar pulse data byapplying Equation 4.

Two features of the image are apparent. First, the vertical features ofthe truck are sharply imaged and are not smeared out in any way by thesinusoidal motion. Second, even though the vibration of the truck is sosmall (1 cm vertically at a rate of 20 Hz), the angular rate of thisresonance (125 rad/second) is readily seen in the image, and isexpressed in the motion of each of the scatterers independently.

The GMAP approach was used to perform the estimation of the vibrationalfrequency without actually evaluating or reconstructing the radar image,as illustrated in FIG. 6. Evaluation of the total energy contained in atile which can be a quadrant or a subquadrant is accomplished via asingle matrix-vector multiply, represented by the computation ofEquation (6). Multiresolution parameter estimation takes place in fourpasses in some embodiments. First, the entire image is divided into fourquadrants. The quadrant with the highest total energy is chosen, and theother three are set aside. This process is iterated three more times fora total of 16 matrix-vector multiplies, after which the vibrationalfrequency parameter is estimated to better than one part in 100.

The simple example illustrates the revolutionary power of our GMAPframework to extract more than just position and velocity of a target atthe moment of detection. This power to expand the palette ofdetection-level features to encompass discriminating attributes oftargets, on a per-detection basis, is the key to establishing andmaintaining tracks on ground targets. The advantage may be compared tothe difference between color and black and white. The subtle colors(target attributes) that can be used to associate detections withtargets make the difference between a completely confused scene in whichtracks must be formed from subtle patterns of dots to one wheremultitarget, multisensor tracking is hardly more difficult thanconnecting dots.

Convex Optimization for Compressive Sensing

To see the role of convex optimization in compressive radarcomputations, in some embodiments we first imagine the path space ofgeneralized coordinates to be populated with a set of discrete samplingpoints q_(k), where kϵ{1 . . . K} is an index running over the samplepoints. The concept of a discrete sampling in the path space q may applyto any radar signal processing problem where it is possible to write thephase as a function of the measurement indices and a set of generalizedcoordinates. If nϵ{1 . . . N} is a single index that runs over all ofthe measurement dimensions as described above, we can identify a complexN×K matrix A with elementsA _(nk) =e ^(−iϕ(n|q) ^(k) ⁾.  (10)Often K is much larger than N.

We describe a complex column vector Φ of length K according to:σ(q _(k))=|Φ(q _(k))|²=Φ_(k) ^(*)Φ_(k).  (11)Therefore, Equation (4) can be rewritten Az=Φ. The significantgeneralizations are: (1) The phase is no longer required to be affine inthe generalized coordinates q, and (2) The number of sample points K isnot related to the number of measurements N. In a typical case, thereare more generalized coordinates than measurement dimensions, so themapping from measurements to image is not a transform in the ordinarysense. It is a one-to-many mapping. Nonetheless, Equation Az=Φ allows usto recast the imaging equation in the form of a matrix-vector multiply.We do not know, however, the actual physical paths of actual pointscatterers in the target region. In other words, the path points q_(k)in the path space that correspond to the actual physical paths of actualpoint scatterers, i.e., A_(n,k) are not known. Different candidatevalues of A_(n,k) can result in different Φ vectors corresponding to aparticular set of radar observations.

It is possible to adopt a completely different view of imaging that ismore closely related to tomography than to Fourier analysis. For thispurpose, we picture the values Φ_(k) of the complex image at a set ofsample points to physically represent moving point scatterers in thescene. In other words, we replace our original concept of the radarscene as a transformation of electromagnetic signals with the concept ofthe scene as a set of delta functions in the path space q. The aim ofimaging, in this view, is to estimate the values of the model parametersΦ_(k). The n^(th) sensor measurement z_(k)(n) that would result from thepresence of a delta function Φ_(k), viewed as a bit of complex RCS atgeneralized image position q_(k), is:z _(k)(n)=Φ_(k) e ^(+iϕ(n|q) ^(k) ⁾  (12)

At the same level of approximation that we have adopted all along(single scattering from each point without second bounce) we model themeasurements z_(n) as the sum of scattering from each of the deltafunctions at points q_(k). Equating the actual measurement vector z_(n)with this tomographic model, we have:z=A ^(†)Φ,  (13)where the symbol A† denotes the complex conjugate transpose of thegeneralized matrix given by Equation 10. Equation 13 has the form of asystem of complex linear equations, one equation for each measurementz_(n). This system of equations is already under-determined in cases ofpractical interest, and it will be more so if some of the measurementsare not present. Nonetheless, it is possible to obtain the sparsestsolution vector Φ that is consistent with the equations. In someembodiments, they can be achieved by minimizing the l₁-norm of thesolution subject to the linear equations, taken as constraints.

This problem is different than standard compressive sensing problems,which can be solved by linear programming, because the correct l₁-normof a complex vector is not the sum of absolute values of real numbersbut the sum of moduli of complex numbers. In some embodiments thisproblem is recast as a Second Order Cone Program (SOCP). SOCP is a moregeneral type of convex optimization than linear programming, and iscapable of solving a very wide variety of convex optimization problems.A fairly exhaustive list of SOCP-solvers includes native MATLAB solversSeDuMi and SDPT3, commercial solvers Gurobi and MOSEK, and three newembedded solvers written in C: Embedded Cone Solver (ECOS), Primal DualOperator Splitting solver (PDOS), and Splitting Cone Solver (SCS). Itshould be understood that SOCP is a technique for solving optimizationproblems just as L-U decomposition is a technique for solving a systemof linear equations or gradient projection is a technique for solvingnonlinear equations. SOCP solutions at large do not determineintensities of paths. To that end, physical paths must be mapped to apath space, and constraints corresponding to the mapped paths based onantenna observations must be generated.

The Generalized Compressive Processing (GCP), i.e., compressive radarsignal processing in terms of convex optimization, can be applied tomany radar signal processing problems where the reflection phases ofcandidate scatterers can be modeled physically with a phase functionϕ(n|q) involving parameters q. The situations where GCP formalism can beapplied include beamforming, SAR, ISAR, STAP, GMTI, bistatic andmultistatic radar, as well as entirely new types of radar sensingaccording to some embodiments that make use of models of targetattributes, as described above.

The following example illustrates the application of GCP to a problem inimaging. This problem is relevant because (1) it has immediate physicalsignificance (2) the phase function is not affine and (3) the path spaceq of generalized coordinates has a higher dimension than the measurementvector, and includes nonlinear scatterer motion. These are all featuresof GCP that make it more general than existing compressive radarapproaches.

FIG. 7 shows the image of a rotating rigid structure having sixscatterers arranged in a ring with a radius of 2 meters. The phase modelcorresponding to rotating scatterers is:ϕ(f,t|r,θ,ω)=r cos(ωt+θ)  (14)This image σ(r, θ, ω) was created using the GMAP technique described byEquation 4. The ring is rotating at an angular velocity ω of 2.72radians/seconds, with the radar located in the far field in the plane ofthe scatterers. The sensor is modeled as an S-band radar with a centerfrequency of 3.0 GHz, 300 MHz bandwidth, a pulse repetition frequency of500 Hz, a pulse width of 0.1 microseconds and a coherent dwell time of0.1 seconds. These parameters correspond to a radar that is very modestby imaging standards, but GMAP already produces a high quality imageusing a single matrix-vector multiply.

FIG. 8 shows the result of processing the same radar data using the GCPalgorithm based on Equation 13, but taking only 10% of measurementstaken at the Nyquist rate. The impulses in path space q=(r, θ, ω) arerecovered exactly in this case, while reducing the sensor measurementsand required communication capacity by 90%.

Convex Optimization for Tracking

The GCP approach described above is well suited for tracking applicationof ground-based targets. We now describe a framework for the applicationof convex optimization to the unique problems of multisensor tracking.As an illustrative, nonlimiting example, we describe some embodiments inwhich tracking is performed using the entropy maximization technique tosolve the problem of orbital track reconstruction and discriminationfrom radar data. In particular, we utilize radar returns over a muchlonger observation window (minutes and tens of minutes—not seconds) asis done in many other systems, in which data from only a single datacollection period such as a coherent dwell is used for greatly improvedintegrated tracking and discrimination. Using the collected data, weextract key information related to the ballistic motion of a launchedobject by working in a state-space of orbital invariants. The dynamictracking problem is reduced to static non-linear optimization. Invarious embodiments, time is not measured by the counting ofmeasurements, or by seconds on a clock, but by the accumulation ofinformation from measurements. This allows us to employ non-linearstatic constrained minimization that we can achieve using convexoptimization techniques.

Many current trackers are based on track filtering that was originallydeveloped for air targets. This has led to a mental attitude that databecome “stale” after a short time such as a data-collection interval,typically measured in seconds. Properly understood, this attitude isinappropriate to tracking in a model-based setting. Measurements areequally valid and useful from the beginning of the engagement to theend. Every measurement provides new information that should beconverging to the most correct decision. Track time or measurement timehas very little fundamental significance. In many conventional systems,tracking is viewed as a real-time activity where high priority is givento the newest measurements and older measurements (more than a fewseconds old) are ignored.

Some embodiments described herein do not ignore or underweight oldermeasurements and, instead, feature a long time-scale multi-targetmodel-based tracking concept that is more closely related to the problemof parameter estimation than to traditional track filtering based onrecursive least squares by working almost entirely in the space of trackinvariants rather than traditional state-space. FIG. 9 underscores thistheme. The track of a ballistic target is not an ephemeral object but aninvariant structure in space and time.

A ballistic trajectory can be described in various ways. One simple anddirect description is in terms of the complete set of six invariantsthat appear in the solution of the orbital problem in classicalmechanics. For example, a model of a track can be the Kepler 1/r²gravity model for a small satellite orbiting the Earth. For improvedaccuracy (e.g. for times on the order of more than tens of minutes, orfor very fast satellites), there exists an exact closed-form solutionthat accounts for the oblateness of the Earth in the second and thirdorders, that may be used.

The six invariant physical quantities that are needed to describe aballistic orbit are: (1) The total energy E; (2) The orbital angularmomentum magnitude L; (3-5) The orientation of the orbit in space(expressed, for example, as three Euler angles or a direction cosinematrix referred to ECI coordinates); and (6) The time of periapsisreferred to UTM. The classical state-space (x,v) that describes themotion of a tracked target is six dimensional. It implicitly assumesuniform rectilinear motion, and is valid only over sufficiently shorttime scales (a few seconds). The gravitational force can be handled toleading order by adding three additional acceleration states to thismodel, as is often done. The additional states are redundant, since theorbit of any object in ballistic freefall is determined entirely by sixinvariant parameters, as listed above.

To enumerate the invariants, we first represent a system of Cartesiancoordinates that is uniquely fixed in the orbit. This is possiblebecause an elliptical orbit, as long as it is eccentric and notcircular, represents a completely orientable object in three-dimensionalspace. FIG. 10 illustrates one unique definition of an orbit-fixed frameof reference. The x-axis is oriented along the long axis of the ellipse,the y-axis is oriented along the short axis, and the z-axis is the crossproduct of the two. This defines a three-dimensional reference frame Othat is fixed by the orbit itself.

The transformation between this orbit-fixed frame and an inertial frame(the Earth-centered inertial frame E) is described by a 3×3 orthogonalmatrix [O E]. The three angles (θ,ϕ,ψ) that are needed to describe thisrotation are the three Eular angles the six orbital invariants. Onefourth of the model is the time T at which the object passes throughperiapsis, as measured in universal standard time (UTM). The other twomay be the semi-major and the semi-minor axis of the elliptical orbit.They are related in an elementary way to the orbital angular momentum Land the total energy E, which are invariant on physical grounds (theorbital system as a whole is not subject to any external torques orforces).

The six invariant coordinates q={L,E,θ,ϕ,ψ,T} fix the position of thetarget object at any time, but they form a better state space fortracking than the traditional one based on position and velocity, sincea specific orbit is now nothing but a point in the space, to beestimated based on measurements. This can be viewed as a parameterestimation problem and not a tracking problem in the ordinary sense. Thestate of the system is fixed and does not evolve over time, as does thestate of a target when referred to the conventional state space.

Probability enters the picture in this situation because we lack perfectknowledge of this state. Our state of knowledge of the target scene isexpressed by a probability density function p(q)=p(L,E,θ,ϕ,ψ,T). Thisprobability density is determined by the measurements, but is no longertied to the order in which the measurements were acquired. The ultimateaim of the tracker is to estimate the six invariant coordinates of eachtracked object, given only the measurements. Because the states areinvariant in this formulation, we see that this problem is bettercharacterized as an optimization problem than as tracking in the morefamiliar sense.

FIG. 11 shows a variety of convex functions. Convex optimization greatlyexpands the types of optimization problems that can be solvedefficiently. Types of criteria that can be optimized include maximumlikelihood, maximum entropy, least squares, and combinations of convexcriterion functions with Lagrange multipliers. Also, constraints areeasily incorporated into the problem within the framework of modernconvex solvers. In the tracking problem, the fundamental constraints arethat that the track correspond to a model, at the deployment time andthe measurements themselves.

In some embodiments, we formulate and solve the problem of tracking ininvariant space as a constrained optimization problem in which one ormore candidate track models and the sensor measurements are used asconstraints. To see how the measurements themselves can be understood asconstraints on the optimization problem, we see that the position andvelocity of the target are known functions of time and the six orbitalinvariants, which we can denote collectively by a single symbol, asq=(E,L,θ,ϕ,ψ,T).

The extension of this probabilistic idea to multitarget tracking dependson the notion that a multitarget track state is a multimodal probabilitydistribution like the one depicted in FIG. 12.

Traditional track filters including the Kalman filter and many othersrest on the fundamental assumption that the tracking problem is linearleast squares optimization. This assumption is made not primarilybecause all tracking problems are truly linear least squares problems,but because more general methods of fast convex optimization did notexist at the time when these methods were developed in the 1960s and1970s. A linear least squares problem has the helpful property that itssolution reduces to a system of linear equations. Methods ofoptimization that could not be reduced to this form were simplyconsidered intractable at the time that tracking was developed,therefore the approximations of linearity were made. Such inaccurateapproximations are not needed in some embodiments described herein.

To give a brief review of the multisensor tracking problem in itsgeneral form, we first suppose that the path of a target being trackedis some parametric function of time and a set of parameters {q}, anddenote it symbolically as x(t|q). This is only a statement of Newton'slaw, or rather that there exists a solution to Newton's law depending ontime and invariants. This is true classically as long as there are nounmodeled forces. The length of time for which a model may be consideredvalid depends to a large degree on how precisely the forces are modeled.

Classical tracking often assumes the elementary six parameter model:x(t|x ₀ ,v)=x ₀ +vt  (15)or in some cases adds a linear acceleration term. The observables arefurther restricted by convention to be the dot products of x or v withknown constant vectors (e.g. projected ranges, projected velocities,angles of array incidence). In our more general formulation of thetracking problem, the observables can be any scalar functionalsθ[x(t|q)] of the target path, and the parameters q can be any set of theinvariant parameters needed to describe the path. The functional mapsthese parameters to a function describing the motion of the object to beblocked. For one practical example, the path of a target can be aballistic trajectory, which can be described by the orientation in spaceand the semimajor and semiminor axes of an ellipse, along with a phaseangle or time offset from periapsis.

The state q*, and hence the target position x(t|q*) at any earlier orlater time can be found by minimizing the sum of squared differencesbetween these functionals evaluated at observation times t and theobserved values θ_(M)(t) at the corresponding times. θ_(M) is notrelated to θ. This gives rise to a general nonlinear principle of leastsquares that cannot be solved by classical matrix inversion, but may besolved using convex optimization as:

$\begin{matrix}{{{Minimize}\mspace{14mu}{\Psi(q)}} = {\sum\limits_{t}\left( {{\theta\left\lbrack {x\left( t \middle| q \right)} \right\rbrack} - {\theta_{M}(t)}} \right)^{2}}} & (16)\end{matrix}$

More generally, in some embodiments, tracking may be described inprobabilistic terms, where a probability density, formally called the‘track’ is assigned over the space of generalized coordinates q. Inclassical tracking, this probability density is taken to have the formof a multivariate Gaussian density (whether or not that is actually thecase). A very general and correct formulation of the tracking problem isgiven by the principle of maximum entropy. If we assume that the objectof interest (the track) is a probability distribution p(q) representingour knowledge of the target state following some sequence ofmeasurements, this track is the solution to the optimization problem:Maximize H [p(q)] subject to: E[x(t|q)]=θ_(m)(t).  (17)Here H[p]=∫p(q) log p(q) dq is the entropy of the probabilitydistribution, and the symbol E(.) denotes the expected value of theargument taken over the probability density p(q).

Entropy being a convex function, the problem can again be solved usingtechniques of fast convex optimization, without recourse to the many adhoc approximations that were previously needed to force the optimizationinto the mold of a linear least squares problem. The extension of theoptimization to multiple sensors in some embodiments only requires theintroduction of a second index, s, (for sensor) alongside the index, t,that runs over measurements, so that the measurements and themeasurement functionals refer to multiple sensors. These techniquesusing fast, general convex optimization routines allow a radar toperform generalized tracking that simultaneously takes account ofnon-trivial kinematic parameters (e.g. the parameters of sinusoidalmotions) that can be the fingerprints needed for automatic feature-aidedtracking of ground targets.

Maximum Entropy Tracking

In some embodiments, sensor measurements θ_(n) are taken at a set oftimes τ_(n) where n∈{1 . . . N}. These measurements are scalar functionsof the position of the target, such as range, range rate, or angles asmeasured by a sensor, where the position and orientation of the sensoris known. The sensor can be a radar, an optical sensor like a camera, ora lidar, for example.

We suppose that the position of the target is modeled by a function oftime x(t|q) involving a set of parameters q. It is assumed that thismodel is valid throughout the time during which the measurements areacquired. Ballistic tracking is one example of such a parametric model,since the tracks of all ballistic objects are orbits depending strictlyon time and six orbital parameters, valid for a long time that ismeasured in hours for a target in low earth orbit (LEO), and for days orweeks for an object in medium earth orbit (MEO) or higher. The model isvalid indefinitely for larger more distant objects such as planets. Theorbital model is valid throughout the exoatmospheric phase of aballistic rocket trajectory, which can last up to 30 minutes. Themeasurements are expressed according to the motion model as:θ(t|q)=θ(x(t|q))  (18)

If every possible path is assigned a probability, we obtain aprobability density function p(q) over the space q of generalizedcoordinates. This probability density generalizes the conventionalconcept of target track. We will call p(q) the track. The goal oftracking is to find or estimate this function from the set of discretemeasurements {θ_(n), n=1 . . . N}

A general method of finding the probability density function satisfyingnumerical constraints is the Maximum Entropy Method (MEM). This methodgenerally insures that no information is used in estimating theprobability density other than the measurements themselves. It canproduce an unbiased estimate consistent with the measurements.Specifically, the objective in some embodiments is to maximize:H[p(q)]=∫dq p(q)ln(p(q))  (19)Subject to the N constraints:∫dqθ(t _(n) |q)p(q)−θ_(n)=0  (20)Along with the normalization constraint:∫dq p(q)=1  (21)The constraints express the idea that each measurement matches theexpected value taken over all possible paths.

Equation (19) and Equation (20) are continuous equations over pathspace. To compute the function p(q) we need a numerical representationfor this function. One representation is a Monte-Carlo representation(point cloud). To obtain this representation, in some embodiments, wespecify a set of K sample points {q_(k):k∈1 . . . K} at random. Thediscrete values p_(k)=p(q_(k)) represent the point-cloud representationof the probability density. This discrete formulation results in thealgebraic optimization program as follows:

Maximize

$\begin{matrix}{\sum\limits_{k}{p_{k}\ln\mspace{11mu} p_{k}}} & (22)\end{matrix}$Subject to

$\begin{matrix}{{{\sum\limits_{k}{{\theta\left( {t_{n},q_{k}} \right)}p_{k}}} = \theta_{n}}{{\sum\limits_{k}p_{k}} = 1}} & (23)\end{matrix}$which has the form of the optimization of a convex function in the Kunknowns p_(k) subject to a set of linear equality constraints.Equations (22) and (23) represent a convex optimization problem instandard form that can be solved efficiently using, for example, aSecond Order Cone Program (SOCP).

Another technique for representing the distribution p(q) parametricallyis as a mixture of M separate Gaussian distributions (Gaussian mixturemodel). This model generally requires fewer parameters than the pointcloud model when there are only a few targets in the scene, and theirindividual distributions are well-modelled by multivariate Gaussianballs. This model corresponds with the assumptions inherent inconventional multi-target tracking. Let the mean of distribution m begiven by the column vector |q_(m)

, let the covariance be given by Ĉ_(m), and let

q_(m)|=|q_(m)

^(T) denote the transpose of the mean (a row vector), then the Gaussianmixture model is:

$\begin{matrix}{{p(q)} = {\sum\limits_{m = 1}^{M}{A_{m}{\exp\left\lbrack {{- \frac{1}{2}}\left( {\left\langle q \right. - \left\langle q_{m} \right.} \right){{\hat{C}}_{m}\left( {\left. q \right\rangle - \left. q_{m} \right\rangle} \right)}} \right\rbrack}}}} & (24)\end{matrix}$

If the dimension of the path space is P, the number of parameters is MPfor the M mean vectors, MP(P−1) for the M symmetric covariance matricesand M for the mixing coefficients A. We can denote the J=M (P²+1) modelparameters by the letter α, so Equation (24) can be written formally asp(q,α). The Entropy functional given by Equation (19) is then anumerical function of these parameters. If the number of measurements isN, we can incorporate the constraints via (N+1) Lagrange multipliers asfollows. Maximize:Λ(α,λ)=∫dq p(q,α)ln(p(q,α))+λ₀(1−∫dq p(q,α))+λ_(n)(∫dqθ(t _(n)|q)p(q,α)−θ_(n))  (25)The parameters and the multipliers can be found by maximizing thisfunction. The numerical optimization problem is non-linear, but itadmits an efficient iterative numerical solution.Examples of Tracks

Examples in addition to orbits, where a parametric model θ(t|q) ofobservables is valid include: (1) Rotational motion in the absence ofexternal torques. Assume the center of mass of a rigid target is known.The Euler angles representing the orientation of the target at any timeare determined by a reference time T and the Euler angles and Eulerangle rates valid at that reference time, via the solution of Euler'sequations of motion. (2) Orientation of a space-stable satellite or asun-tracking satellite with respect to a sensor in known motion relativeto the satellite (e.g. a sensor at a definite position on the rotatingEarth). (3) Position of a boosting rocket. Parameters are the thrust,the mass of the rocket and the mass of the fuel at a reference time,following the rocket equation.

Additional examples include: (4) An object (say a sphere, or a raindropof definite size) falling through the atmosphere in the laminar flowregime. The drag due to air resistance is proportional to the square ofvelocity and the Reynolds number. The downward force is proportional tothe mass. (5) Position of a guided missile subject to a control law, forexample proportional guidance, when the position of the object undertrack can be expressed parametrically (e.g. the missile is following atarget on a ballistic trajectory, based on a definite control law). (6)Cases where the observables are abstract, and not necessarily associatedwith the motion of any target, for example the activity of a mixture ofdecaying radioisotopes measured in Curies. The number of decaying nucleiof each radioactive species at a reference time, and the half-lives ofthe species are the parameters q of the model.

The technique we have described applies to any observable quantity thatis governed by an ordinary differential equation in time, involving someset of constant coefficients. The Q initial conditions and the Ccoefficients of the differential equation, or any set of (Q+C) mutuallyindependent functions of those quantities, together constitute thegeneralized coordinates q. It follows that the method applies togeometrical observables related to the positions and orientations ofrigid objects following any deterministic force law with. Themultidimensional space where every point is a set of parameters q iscalled path space, because each point in path space corresponds to aparticular path.

The co-pending U.S. patent application Ser. No. 14/699,871, entitled“Systems And Methods For Joint Angle-Frequency Determination,” theentire disclosure of which is incorporated herein by reference,describes using compressed data for joint determination of angles andfrequencies of signals received from targets emitting such signals.Unlike the techniques featured in various embodiments described herein,the methods and systems described in the co-pending patent applicationdo not identify objects in a target field and do not determine theirpaths, tracks, and/or other characteristics.

Multistatic SIMO and MIMO

FIG. 13 shows the geometry of a bistatic radar. The transmitter and thereceiver are widely separated. The distances from the transmitter andthe receiver to the target are comparable to the distance between thetransmitter and the receiver. The direct path is used for point-to-pointcommunications, in some embodiments.

The key complication for wideband GMTI and the distributed multistaticarray, unlike a conventional narrowband GMTI radar or a SAR, is that allof the indices {f, e, t} are present. That is, the I&Q data is labeledby frequency, element and pulse time so that the entire data cube mustbe processed. This generally increases the bandwidth requirement forcommunication and the amount of signal processing required. In someembodiments, this communication burden is mitigated by GCP, which cansignificantly (e.g., 10%, 20%, 40%, etc.) reduce the front-end radarsensing requirements across the board. Additionally, or in thealternative, the amount of signal processing required at an element canbe reduced by distributed sensing, which further reduces the amount ofradar data that must be collected by a single element.

GMAP and GCP can be applied to the bistatic and/or multistatic cases. Anadvantage of the distributed multistatic array is the ability to measuretarget position and velocity in two (or even three) dimensions on aper-detection basis. To visualize this, consider the entire set ofelements as a synthetic aperture teat that covers or surrounds thetarget in the far field, so that the distance from the target to anyelement of the array is large compared to the distance that the targetmoves during any given coherent dwell. With GCP, it is feasible to pickout one transmit element per pulse (SIMO operation). For detectingtargets that move on straight lines throughout the coherent dwell, thetwo-way phase function takes the form:

$\begin{matrix}{{\phi\left( {f,e,\left. t \middle| x \right.,y,v_{z},v_{y}} \right)} = {\frac{2\pi\; f}{c}\left( {{{{T\left( {e,t} \right)} - {s\left( {\left. t \middle| x \right.,y,v_{x},v_{y}} \right)}}} + {{{R\left( {e,t} \right)} - {s\left( {\left. t \middle| x \right.,y,v_{x},v_{y}} \right)}}}} \right)}} & (26)\end{matrix}$wheres=(x+v _(x)){circumflex over (x)}+(y+v _(y)){circumflex over (y)}  (27)

Here f is the wideband frequency, e is the index corresponding to one ofthe receivers, t is the pulse time, q={x, y, v_(x), v_(y)} are theposition and velocity coordinates of the target in the ground plane andT (e, t) and R (e, t) are the positions of the designated transmitterand receiver at the given pulse time. By substituting this expressioninto Equation 4, a four dimensional image σ(x, y, v_(x), v_(y)) of thepositions and velocities of targets on the ground can be calculated.

Equations (4) and (13) provide a method for efficiently converging ondetections in the four-dimensional space of target position and velocitywithout ever actually computing the image, which has the potential togreatly reduce the burden on the signal processor. This multiresolutionevaluation technique, in addition to sparsity-based processing, is anessential element of SAKÉ, by allowing the processor to extract theactionable content from the compressed data stream without computing theentire image as described below.

Depending only on the region of integration and the form of the phasefunction, the matrices corresponding to any region of the detectionspace can be precomputed. This suggests the possibility of a generalmultiresolution technique for converging on the peaks in logarithmictime without ever computing the image. The space may be initiallydivided into quadrants, the largest energy quadrant may be selected andthis process can be iterated by further subdivision to converge on adetection. The computation required at each stage of the iteration mayonly be an outer product of the form

z|Q(R)|z

, a computational advantage that was discussed previously. In thesecomputations, the one or more transmitters and the one or more receiversneed the knowledge if each other's relative positions, denoted as T₁,T₂, . . . etc., and R₁, R₂, R₃, . . . etc. These positions may be knownor can be determined and exchanged by the transmitter and receiverelements.

Dual-Use Waveforms

In order to facilitate efficient communication between transmitterand/or receiver antenna or sensor elements, some embodiments employwaveforms that can serve the dual roles in wideband radar sensing andpoint-to-point wideband communications. A suitable radar waveformgenerally has the property of being resilient to interference, noise,and distortion due to multipath effects. For communications, data rateand bit error rates place restriction on the waveforms.

Some embodiments of a distributed radar may use wideband phase-codedwaveforms jointly for radar illumination, array element localization,and communication. FIGS. 14A-C show (a) a sinusoidal waveform as inpulse-Doppler radar, (b) a linear frequency-modulated (LFM) waveformthat is often used for wideband radar sensing and (c) a biphasepulse-coded waveform. In the biphase-coded waveform, sequentialsinusoids are either left unshifted or phase-shifted by 90° at eachzero-crossing. This procedure can produce a wideband waveform suitablefor radar, but can also carry information in the form of the sequence ofphase shifts, which can be used to transmit a binary sequence.

A popular class of biphase codes, called Barker codes, has an ideal flatsidelobe structure and theoretically minimum peak sidelobe level whenself-correlated. The longest sequence with this ideal sidelobe property(13 bits in length) is {+++++−++−+−+} with a peak sidelobe level of−22.3 dB. But this sequence, being fixed, is not useful for transmittinginformation.

It is not immediately evident that a biphase-coded waveform has non-zerobandwidth, as will be needed for radar. Bandwidth is induced by thesharp discontinuities where the sinusoidal waveform switches phase. FIG.15 shows the spectrum of the 13-bit Barker code. This spectrumillustrates that biphase coding generates bandwidth and so is capable inprinciple of carrying information and at the same time performingwideband radar sensing functions.

Another waveform that is more suitable for carrying information than afixed code, and at the same time can provide signal bandwidth needed forradar sensing, is a long biphase code with a pseudo-random sequence of90° phase shifts. FIG. 16 shows the mainlobe and sidelobe structure of a1023-point biphase coded waveform generated in this way.

Long pseudorandom biphase sequences like this are suitable for both thecommunication and radar sensing functions of a distributed radar system.Instead of the sequence being drawn at random, it represents the bits ofa binary encoded message that is to be communicated from point-to-point.This message may contain a time-stamp phase element localization, or itmay contain measured I&Q data from the previous pulse that must beshared among the processors in order to perform the coherent radarsignal processing function in a distributed manner.

A third type of waveform that can be used to provide widebandillumination for radar sensing and simultaneously used to communicateinformation is a Costas waveform. A waveform of this type is spectrallyidentical to a linear FM chirp waveform, except that the waveform isdivided into a sequence of time blocks. The portions of the linear FMchirp corresponding to each of these temporal blocks may then betransmitted in an out-of-sequence permutation order. The concept of aCostas waveform is illustrated in FIG. 17. Besides having highlydesirable correlation properties, these waveforms can be used to encodeinformation. A single chirp divided into N temporal blocks can betransmitted in N! ways, incorporating in this way an alphabet of symbolsfor purposes of communication.

Costas waveforms have the property that they can be used in continuouswave form by using alternating consecutive up-chirp and down-chirpsequences. In some embodiments, a continuous Costas-type sequence isused in which there is no attempt to transmit one full chirp at a timein sequence, but rather to visit all of the possible up-and-down chirpsare visited in an ongoing pseudorandom sequence. Such a waveform hassufficient bandwidth for radar sensing and is also capable, like thepseudo-random phase code, of communicating information continuously.

The coding being in the frequency domain, the Costas waveform can beused in the manner of frequency multiplexing rather than time. Thereforemultiple receivers (and optionally transmitters) can work on asimultaneous non-interfering basis by operating in distinct frequencybands. This scheme has some advantages, including the possibility ofpulse-free continuous illumination and communication, and truemultiple-input, multiple-output (MIMO) operation where the differentelements of the array can both broadcast and receive from all of theother elements simultaneously.

Attritable Radar Targeting Using Integrated Swarm Technology (ARTIST)

In some embodiments, the determination of paths of one or more objects,computation of target attributes, and/or tracking can be performed usinga sensing technology, Attritable Radar Targeting using Integrated SwarmTechnology (ARTIST). Various embodiments of ARTIST are based on swarmsof small UAVs equipped with attritable radars. These embodimentsfacilitate sensor integration and may employ compressive sensing and mayuse shared resources to help keep the individual radar sensor andprocessor elements in the swarm power-efficient, small, light, low-costand attritable.

Various ARTIST embodiments feature one or more of: (1) An autonomouscollaborative UAV swarm that performs compressive, adaptive radarsensing; (2) Distributed signal processing via wideband point-to-pointmicrowave communication links carrying information near the sensor datalevel; (3) Dual-use coded waveforms for point-to-point communication andtarget illumination; (4) Distributed multistatic arrays facilitated bynovel signal processing; and (5) Element geolocation and phase lockusing atomic clocks.

Some embodiments facilitate a fully coherent swarm-based radar systemfor prosecuting ground-targets. The capabilities of these embodimentsare applicable to diverse areas of radar including SAR, GMTI, dismountdetection, and many others. Building on the framework of generalizedcoordinates provided by GMAP, we develop an approach to compressiveradar signal processing called Generalized Compressive Processing (GCP)that allows us to perform radar measurements at the Rate of Information(ROI) instead of the much higher classical Nyquist sampling rate. LikeGMAP, GCP encompasses many coherent sensing problems where the phase ofthe measured data can be modeled as a function of the measurementdimensions and some set of physics-based generalized coordinates.

If all of the actionable knowledge is already present in the datameasured at the ROI, then it should be possible to convert this datainto actionable knowledge without ever reconstructing the image. Theembodiments that performs this process is called Sparse ActionableKnowledge Extraction (SAKE), and are described below. Completing thetheme of power efficiency via sharing of resources among elements in theswarm, Some embodiments of ARTIST can distribute the processing loadamong processors located on individual platforms, to save more power.GCP calls for Distributed Convex Optimization (DCO) convex optimization.Our Distributed Convex Signal Processing (DCSP) technology based on DCOmakes it possible to perform these computations with high utilizationacross distributed computing elements connected with high bandwidthmicrowave broadcast data links.

In some embodiments, the distributed radar so-constructed issoftware-defined and reconfigurable in a strong sense: thetransmit/receive elements on separate platforms can rearrange themselvesin space and time to form an agile, spatially reconfigurable syntheticaperture. The configuration of this aperture is restricted only by theflight envelopes of the vehicles in the swarm. The distributed processormay be equipped with advanced multistatic algorithms that perform thereduction of radar data to specified actionable information in aseamless and unified fashion.

Typically, size, weight, power and cost are important considerations inthe design of an active sensor network with attritable elements. Thesedrivers led to the unique features of the different embodiments ofARTIST system. Distributed computation carried out using processors onseparate moving platforms can save weight and power. Distributed,compressive sensing strategies can reduce communication rates and savepower in both sensing and communications. Dual use sensing andcommunication systems may reduce power requirements even further, whilealso contributing to covert operation. Resilient computationalalgorithms enable continued operation when one or more platforms islost.

Attritable Swarm Radar

FIG. 18 illustrates a concept of operations for ARTIST. In this concept,small, power-efficient and inexpensive radar transceivers hosted onindividual aerial platforms replace high value assets and humanoperators. Advanced signal processing and geometrical diversity allowthe sensors to jointly extract kinematic signatures of the movingtargets on the ground at the detection level. Because this auxiliaryinformation is available to the tracking function, long term automaticfeature-aided tracking of ground targets is greatly facilitated.

UAVs are interconnected by high bandwidth microwave communicationchannels capable of sharing raw radar data from one UAV to another. Dualuse waveforms described above may be used in some embodiments. Bydistributing the computations among the different platforms in this way,the weight and power that must be hosted on each platform is reduced.The challenge of moving radar sensing from large manned platforms toswarms of much smaller attritable UAVs is to reduce size, weight, powerand cost on the individual UAVs. ARTIST achieves this goal through acombination of technologies working in a complementary way. In someembodiments, a swarm of UAVs can form the elements of a steerablesurrounding synthetic aperture. Data processing may be carried out in adistributed fashion with high bandwidth point to point microwave datalinks playing the role of a data bus. Dual-use coded waveforms may beemployed for communication and illumination.

In various embodiments, ARTIST achieves the revolutionary savings insize, weight, power and cost that are needed to host radar sensing onsmall unmanned aerial platforms by a combining an unprecedented level ofsensor integration with smart compressive sensing. Compressive sensingusing our GCP technique can reduce the radar measurement load by anorder of magnitude, to the rate of information in the scene. Thismeasurement load may be shared between sensors acting as a singlecoherent aperture to further reduce sensing power requirements by up toanother order of magnitude.

Measuring less in the first place can reduce sensing power requirementsby orders of magnitude, while less measured data enables data-levelfusion of information among swarm elements, enabling some ARTISTembodiments to perform existing radar functions better than monolithicradars, and to perform entirely new functions based on GMAP signalprocessing. On the processing side, signal processing in various SAKEembodiments can reduce measurements taken at the rate of information toactionable knowledge, without the intermediate step of decompressing thedata internally into an image, greatly reducing processor power andmemory requirements. And because information is shared among platformsat the data level, the processing load can be shared among platforms tofurther reduce processing power requirements.

Different embodiments can save power by doing one or more of: (1) Savepower by measuring compressively, measuring less to begin with; (2) Savepower per UAV by sharing the measurement load; (3) Save processing powerthrough SAKE signal processing that reduces data at the rate ofinformation to the actionable knowledge, without the costly intermediatestep of reconstructing images from data; (4) Save power by sharing theprocessing load; and (5) Perform traditional radar functions better, andenable functionalities such as path determination, attribute extraction,and tracking by using the entire integrated swarm as a single radarusing GMAP. The integration of one or more of these strategies meansembodiments of ARTIST may use less power, weigh less, fit in a smallerpackage, and may achieve the goals of radar sensing on attritableunmanned platforms.

Sparse Actionable Knowledge Extraction (SAKÉ)

Compressive sensing has shown that it is possible to reconstruct animage using sensor measurements taken at much lower than theconventional Nyquist rate. Embodiments of ARTIST takes this observationto the next logical step. Compressive, distributed sensing allows ARTISTto save power, cost and data throughput at each of the individualsensors in the swarm, to help achieve the goals of attritable radarsensing.

FIG. 19 shows the flow of information in a conventional airborne sensorand signal processor. The sensor onboard an airborne platform like a UAVtypically gathers information at the Nyquist rate required for perfectFourier reconstruction of a band-limited signal or image. This rate ismuch higher than the rate of information (ROI) that is ultimatelyextracted via digital signal processing and passed on to an operator. Wecall this ultimate data product Actionable Knowledge. In a typical case,actionable knowledge might be a set of target tracks with associatedclassifications. The purpose of the signal processor is to transformmeasured data at the Nyquist rate to Actionable Knowledge at the ROI.The conventional system generally requires reduction of the informationmeasured at the Nyquist rate to actionable information at the rate ofinformation on board a single platform.

The processor first performs a transformation of the measured data intoan image. This is viewed as a lossless process; the measurement domainand the image domain form a transform pair, this transform beinginvertible. This stage of the computation is often performed in aspecial-purpose DSP. The transform to image space is followed by a lossyimage interpretation stage that compresses images at the Nyquist rate toactionable knowledge (e.g. tracks) at the ROI.

FIG. 20 shows an embodiment the (SAKÉ) data flow process for ARTIST.Individual UAVs in the swarm perform measurements at the ROI divided bythe number of sensor elements. These measurements are broadcast andfolded together in the individual processors in the swarm to form astream of information at the ROI. In this broad sense, sensor signalprocessing can be viewed as a type of data compression. In variousembodiments, a SAKÉ system can drastically reduce (e.g., by 10%, 15%,20%, 40%, 50%, 60%, or by more) sensor measurements, processing andthroughput for individual drones in the ARTIST swarm.

The mathematics of compressive sensing witnessed rapid developmentduring the last decade. It has found a number of applications, notablyin the fields of video imaging and medical radiology. Compressivesensing exploits the idea that it is possible under very generalconditions to exactly reconstruct the solution to an underdeterminedsystem of linear equations if we can be sure that the solution is sparse(contains many zeros or near zeros) in the target domain. Such areconstruction can be accomplished, however, if the problem is cast asan optimization problem subject to equations of sensor measurement,expressed as linear equality constraints.

FIG. 20 illustrates many of the aspects of ARTIST. First, the individualsensor elements form a coherent distributed array. This can save powerand cost by reducing the antenna needed on each individual UAV, and mayprovide the geometrical diversity needed to perform advanced signalprocessing including generalized STAP clutter suppression for movingtarget detection.

Compressive sensing allows the elements of the swarm to jointly measureat a rate much lower than the Nyquist rate. The first advantage isprovided by compressive sensing. The second advantage is provided bydistributed sensing. Various embodiments of SAKÉ compressive processingcan bypass the formation of radar images and can extract actionableknowledge at the ROI from compressed measurements at the ROI directly.Distributed processing can share the processing load among all of theelements of the swarm, reducing the power and cost of the processorneeded on the individual UAV platforms. Knowledge may be fed back inreal time to automatically adjust all aspects of the measurementprocess, optimizing the quality of the information extracted. Aspects ofthe distributed sensor array to be optimized include spatial arrayconfiguration, temporal pulse patterns and transmit spectra of eachactive array element.

Communication Cost Optimization

Inter-UAV communication is potentially a major source of energyconsumption. Some embodiments address this problem by broadcastingsparse data among UAVs for free by using the dual-use waveforms. In thisscheme, pulses used to measure data at given time also carry datasampled in the previous iteration as well as intermediate results ofon-going parallel computation. FIG. 21 shows the pictorialrepresentation of the process. A single UAV is shown to transmit adual-use waveform signal. The signal measured by the transmitting UAV isused for ground sensing while the signal traveling in the direction ofthe adjacent UAVs is used to communicate the data sensed by thetransmitting UAV in the previous pulse burst. In case the data bandwidthof the dual waveform is not sufficient, a higher-bandwidth link may beused to perform air-to-air communications. Minimizing the communicationfrequency interactions amongst the UAVs can help save power. Paralleldata sharing processes that avoids redundant exchange of information canalso benefit ARTIST. The distributed UAV swarm can thus perform dualband sensing and communication.

Ground Moving Target Tracking

Embodiments of ARTIST can perform Ground Moving Target Tracking (GMTT),a critical radar function. The challenge in GMTT is to piece togetherthe continuous track of a moving ground vehicle, and follow it through along sequence of activities that may include commonplace trafficmaneuvers (e.g. periodic stops and turns in the vicinity of nearbyvehicles and ground clutter) or may be expressly evasive in character,as when the driver of the target vehicle is aware that he may be undersurveillance. Embodiments of GMAP signal processing techniques providethe ability to detect a ground vehicle in two dimensions of position andtwo dimensions of velocity.

ARTIST GMAP signal processing can tag detections with target attributesextracted as described above to provides the key to overcoming classicalchallenges in GMTT. FIG. 22 illustrates one of the fundamentalchallenges encountered in classical target tracking, called crossingtracks. Two tracks cross in the scene, but the conventional radar view(illustrated via a sequence of track covariances on the right) is ‘colorblind’ without additional discriminating features per target detection.This creates significant confusion when trying to track and maintain theidentity of a ground vehicle over a long period of time. The scene onthe left shows two vehicles meeting at an intersection. If we assumethat Vehicle A is under surveillance, the probability of switching trackwith Vehicle B is high. Without actual detections during the precisemoment of crossing, and being blind to the colors (i.e. lacking stronglydiscriminating target features) the radar ‘sees’ a single vehicle movingfrom left to right, whereas the two vehicles have switched places. Thetrack of Vehicle A is lost. GMAP signal processing can tag detectionswith attributes that uniquely fingerprint the targets in the scene, ineffect restoring color to the scene to allow the targets to be correctlytracked through the maneuver. Thus, ARTIST GMAP-based classification offeatures in some embodiments, such as determination of characteristicsof vibrations of a stopped vehicle, can help provide continuous trackingthrough target crossing events.

The ability of various embodiments described herein to providesimultaneous stationary and moving target features helps mitigate otherchallenges that arise when using conventional GMTT radar. One or bothvehicles may most often stop completely at the intersection. Astationary vehicle cannot be distinguished from ground clutter usingconventional processing, and thus may become invisible to the radar onceit has come to a stop. It only reappears to the conventional radar whenit regains sufficient velocity to be re-acquired. The metric calledMinimum Detectable Velocity (MDV) expresses this idea. Even a radarsystem with an exceptional MDV of a few miles per hour will have (atbest) even odds of maintaining continuous track on the vehicle undersurveillance. GMAP simultaneous SAR and GMTI sensing can address thesechallenges.

As discussed herein, mapping candidate locations, paths, and/or tracksfrom a physical space to a parameterizable path space, and optimizing afunction of expected sensor phases or track probabilities subject toconstraints based on observed sensor signals cannot be considered to bea mathematical or mental concept. These operations that takes intoconsideration the observed sensor data and models of paths and/or tracksof physical motion, as described above, is also not merely performinggeneric computer and/or database operations and is also not mere dataorganization or reorganization.

Unlike any generic operations such as data transmission and reception,unlike usual computer functions such as storage and access ofinformation, and unlike any mathematical or mental processes such ascomparing and categorizing information, the unconventional operationsinvolved in mapping and optimizations, as described herein, arespecifically orchestrated. Specifically, the mapping enables explorationof several candidate physical paths (including object features) ortracks and the optimization can take advantage of the sparsity of thesepaths and tracks to find the actual likely paths, tracks, and otherfeatures such as mechanical vibrations among several candidates in anefficient manner. These specific operations make the methods and systemsfor mapping and optimization limited and specialized techniques ofminimizing the cost of sensors and data processing systems, whileachieving the desired performance.

It is clear that there are many ways to configure the device and/orsystem components, interfaces, communication links, and methodsdescribed herein. The disclosed methods, devices, and systems can bedeployed on convenient processor platforms, including network servers,personal and portable computers, and/or other processing platforms.Other platforms can be contemplated as processing capabilities improve,including personal digital assistants, computerized watches, cellularphones and/or other portable devices. The disclosed methods and systemscan be integrated with known network management systems and methods. Thedisclosed methods and systems can operate as an SNMP agent, and can beconfigured with the IP address of a remote machine running a conformantmanagement platform. Therefore, the scope of the disclosed methods andsystems are not limited by the examples given herein, but can includethe full scope of the claims and their legal equivalents.

The methods, devices, and systems described herein are not limited to aparticular hardware or software configuration, and may findapplicability in many computing or processing environments. The methods,devices, and systems can be implemented in hardware or software, or acombination of hardware and software. The methods, devices, and systemscan be implemented in one or more computer programs, where a computerprogram can be understood to include one or more processor executableinstructions. The computer program(s) can execute on one or moreprogrammable processing elements or machines, and can be stored on oneor more storage medium readable by the processor (including volatile andnon-volatile memory and/or storage elements), one or more input devices,and/or one or more output devices. The processing elements/machines thuscan access one or more input devices to obtain input data, and canaccess one or more output devices to communicate output data. The inputand/or output devices can include one or more of the following: RandomAccess Memory (RAM), Redundant Array of Independent Disks (RAID), floppydrive, CD, DVD, magnetic disk, internal hard drive, external hard drive,memory stick, or other storage device capable of being accessed by aprocessing element as provided herein, where such aforementionedexamples are not exhaustive, and are for illustration and notlimitation.

The computer program(s) can be implemented using one or more high levelprocedural or object-oriented programming languages to communicate witha computer system; however, the program(s) can be implemented inassembly or machine language, if desired. The language can be compiledor interpreted. Sets and subsets, in general, include one or moremembers.

As provided herein, the processor(s) and/or processing elements can thusbe embedded in one or more devices that can be operated independently ortogether in a networked environment, where the network can include, forexample, a Local Area Network (LAN), wide area network (WAN), and/or caninclude an intranet and/or the Internet and/or another network. Thenetwork(s) can be wired or wireless or a combination thereof and can useone or more communication protocols to facilitate communication betweenthe different processors/processing elements. The processors can beconfigured for distributed processing and can utilize, in someembodiments, a client-server model as needed. Accordingly, the methods,devices, and systems can utilize multiple processors and/or processordevices, and the processor/processing element instructions can bedivided amongst such single or multiple processor/devices/processingelements.

The device(s) or computer systems that integrate with theprocessor(s)/processing element(s) can include, for example, a personalcomputer(s), workstation (e.g., Dell, HP), personal digital assistant(PDA), handheld device such as cellular telephone, laptop, handheld, oranother device capable of being integrated with a processor(s) that canoperate as provided herein. Accordingly, the devices provided herein arenot exhaustive and are provided for illustration and not limitation.

References to “a processor”, or “a processing element,” “the processor,”and “the processing element” can be understood to include one or moremicroprocessors that can communicate in a stand-alone and/or adistributed environment(s), and can thus can be configured tocommunicate via wired or wireless communication with other processors,where such one or more processor can be configured to operate on one ormore processor/processing elements-controlled devices that can besimilar or different devices. Use of such “microprocessor,” “processor,”or “processing element” terminology can thus also be understood toinclude a central processing unit, an arithmetic logic unit, anapplication-specific integrated circuit (IC), and/or a task engine, withsuch examples provided for illustration and not limitation.

Furthermore, references to memory, unless otherwise specified, caninclude one or more processor-readable and accessible memory elementsand/or components that can be internal to the processor-controlleddevice, external to the processor-controlled device, and/or can beaccessed via a wired or wireless network using a variety ofcommunication protocols, and unless otherwise specified, can be arrangedto include a combination of external and internal memory devices, wheresuch memory can be contiguous and/or partitioned based on theapplication. For example, the memory can be a flash drive, a computerdisc, CD/DVD, distributed memory, etc. References to structures includelinks, queues, graphs, trees, and such structures are provided forillustration and not limitation. References herein to instructions orexecutable instructions, in accordance with the above, can be understoodto include programmable hardware.

Although the methods and systems have been described relative tospecific embodiments thereof, they are not so limited. As such, manymodifications and variations may become apparent in light of the aboveteachings. Many additional changes in the details, materials, andarrangement of parts, herein described and illustrated, can be made bythose skilled in the art. Accordingly, it will be understood that themethods, devices, and systems provided herein are not to be limited tothe embodiments disclosed herein, can include practices otherwise thanspecifically described, and are to be interpreted as broadly as allowedunder the law.

What is claimed is:
 1. A method for analyzing motions of objects, themethod comprising performing by a processor the steps of: (a1)representing as a first path point in a path space a first expected pathof motion of a first point scatterer in a physical space, the firstexpected path in the physical space comprising a plurality of locationsin the physical space; (b1) generating a first steering vector based ona first plurality of phase shifts at a receiving antenna, the firstplurality of phase shifts corresponding to an association between thefirst point scatterer and the first path point; (c1) computing a firstfield by manipulating a plurality of antenna observations using thefirst steering vector; and (d1) determining, based on an intensity ofthe field, whether the first point scatterer traveled along the firstexpected path.
 2. The method of claim 1, wherein: the path spacecomprises a parametric space; and at least one parameter of theparametric space is selected from the group consisting of: a position, alinear velocity, and an angular velocity.
 3. The method of claim 1,wherein the representation of the first path point in the path spacecomprises one of: a three dimensional position vector; a six dimensionalvector comprising a three dimensional position vector and a threedimensional velocity vector; and a vector comprising a six dimensionalvector representing rigid body motion and a position vector.
 4. Themethod of claim 1, wherein: the receiving antenna comprises N_(E)elements, each element being associated with up to N_(F) frequencies andup to N_(T) pulses forming a single dwell; and each one of the firstplurality of phase shifts is associated with an antenna element, one ofthe N_(F) frequencies, and one pulse.
 5. The method of claim 4, whereina number of the plurality of antenna observations is less thanN_(E)*N_(F)*N_(T).
 6. The method of claim 4, wherein the first expectedpath of motion of the first point scatterer in the physical spacecorresponds to a single dwell of the antenna, the single dwellcorresponding to N_(E) elements, N_(F) frequencies, and N_(T) pulses. 7.The method of claim 1, further comprising: (a2) representing as a secondpath point in the path space a second expected path of motion of thefirst point scatterer in the physical space, the second expected path inthe physical space comprising another plurality of locations in thephysical space; (b2) generating a second steering vector based on asecond plurality of phase shifts at the receiving antenna, the secondplurality of phase shifts corresponding to an association between thefirst point scatterer and the second path point; (c2) computing a secondfield by manipulating the plurality of antenna observations using thesecond steering vector; and (d2) determining, based on an intensity ofthe first field and the second field, whether the first point scatterertraveled along the first expected path or the second expected path. 8.The method of claim 1, further comprising: (a2) representing as a secondpath point in the path space a second expected path of motion of asecond point scatterer in the physical space, the second expected pathin the physical space comprising another plurality of locations in thephysical space; (b2) generating a second steering vector based on asecond plurality of phase shifts at the receiving antenna, the secondplurality of phase shifts corresponding to an association between thesecond point scatterer and the second path point; (c2) computing asecond field by manipulating the plurality of antenna observations usingthe second steering vector; (d2) determining, based on an intensity ofthe second field, whether the second point scatterer traveled along thesecond expected path; (e) determining via a comparison of the first andsecond path points whether a rigid body is associated with the first andsecond point scatters; and (f) determining whether the rigid bodytraveled along a path in the physical space associated with at least oneof the first and second expected paths.
 9. A method for analyzingattributes of objects, the method comprising performing by a processorthe steps of: (a) representing as a distribution of path points in apath space expected paths of motion of a point scatterer in a physicalspace, each expected path in the physical space comprising a pluralityof locations in the physical space; (b) generating a distribution ofsteering vectors based on a plurality of phase shifts at a receivingantenna, the plurality of phase shifts corresponding to an associationbetween the point scatterer and the distribution of path points; (c)computing a field-intensity distribution based on, at least in part, aplurality of antenna observations and the distribution of steeringvectors; and (d) determining, based on the field-intensity distribution,a path of a first point scatterer in the physical space.
 10. The methodof claim 9, wherein computing the field-intensity distribution comprisesapplying adaptive weights to at least one of: (i) one or more of theplurality of antenna observations, and (ii) the distribution of steeringvectors, the adaptive weights being selected to minimize interferencefrom an interfering point scatterer in the physical space.
 11. Themethod of claim 9, wherein: computing the field-intensity distributioncomprises: partitioning the path space into first-level regions;computing the field intensity for each first-level region; selecting afirst-level region having maximum field intensity; partitioning pathspace in the selected region into second-level regions; computing thefield intensity for each second-level region; and selecting asecond-level region having maximum field intensity; and determining thepath in the physical space comprises selecting a representative pathpoint within the selected second-level region; and identifying a path inthe physical space that corresponds to the representative path point.12. The method of claim 9, further comprising determining, based on thefield-intensity distribution, a path of a second point scatterer in thephysical space.
 13. The method of claim 12, further comprising:determining via a comparison of the paths of the first and second pointscatterers that a rigid body is associated with the first and secondpoint scatterers.
 14. The method of claim 13, further comprising:determining the path of the rigid body in the physical space based on atleast one of the path of the first point scatterer and the path of thesecond point scatterer.
 15. The method of claim 13, further comprising:determining an attribute of the rigid body based on at least one of thepath of the first point scatterer and the path of the second pointscatterer.
 16. The method of claim 15, wherein the attribute of therigid body is selected from the group consisting of a range, a velocity,and an angular velocity.